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Abstract 

In this paper we develop a new technique for proving lower bounds on the update time and query 
time of dynamic data structures in the cell probe model. With this technique, we prove the highest 
lower bound to date for any explicit problem, namely a lower bound of t q — 0((lgn/lg(wt„)) 2 ). Here 
n is the number of update operations, w the cell size, t q the query time and t u the update time. In the 
most natural setting of cell size w — 0(lgn), this gives a lower bound of t q = fi((lg n/ lg lg n) 2 ) for any 
polylogarithmic update time. This bound is almost a quadratic improvement over the highest previous 
lower bound of fi(lgn), due to Patrascu and Demaine [SICOMP'06]. 

We prove the lower bound for the fundamental problem of weighted orthogonal range counting. In 
this problem, we are to support insertions of two-dimensional points, each assigned a 0(lgn)-bit integer 
weight. A query to this problem is specified by a point q = (x,y), and the goal is to report the sum of 
the weights assigned to the points dominated by q, where a point (a/, y') is dominated by q if x' < x and 
V < V- in addition to being the highest cell probe lower bound to date, the lower bound is also tight for 
data structures with update time t u — f2(lg 2+e n), where e > is an arbitrarily small constant. 
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1 Introduction 



Proving lower bounds on the operational time of data structures has been an active line of research for 
decades. During these years, numerous models of computation have been proposed, including the cell probe 
model of Yao [T2]. The cell probe model is one of the least restrictive lower bound models, thus lower 
bounds proved in the cell probe model apply to essentially every imaginable data structure, including those 
developed in the popular upper bound model, the word RAM. Unfortunately this generality comes at a cost: 
The highest lower bound that has been proved for any explicit data structure problem is f2(lgn), both for 
static and even dynamic data structures^. 

In this paper, we break this barrier by introducing a new technique for proving dynamic cell probe lower 
bounds. Using this technique, we obtain a query time lower bound of £~2((lg n/ lg lg n) 2 ) for any polylogarith- 
mic update time. We prove the bound for the fundamental problem of dynamic weighted orthogonal range 
counting in two-dimensional space. In dynamic weighted orthogonal range counting (in 2-d), the goal is to 
maintain a set of (2-d) points under insertions, where each point is assigned an integer weight. In addition 
to supporting insertions, a data structure must support answering queries. A query is specified by a query 
point q = (x, y), and the data structure must return the sum of the weights assigned to the points dominated 
by q. Here we say that a point (x 1 ', y') is dominated by q if x' < x and y' < y. 

1.1 The Cell Probe Model 

A dynamic data structure in the cell probe model consists of a set of memory cells, each storing w bits. 
Each cell of the data structure is identified by an integer address, which is assumed to fit in w bits, i.e. each 
address is amongst [2 W ] = {0, . . . ,2 W — 1}. We will make the additional standard assumption that a cell 
also has enough bits to address any update operation performed on it, i.e. we assume w = f2(lgn) when 
analysing a data structure's performance on a sequence of n updates. 

When presented with an update operation, a data structure reads and updates a number of the stored 
cells to reflect the changes. The cell read (or written to) in each step of an update operation may depend 
arbitrarily on the update and the contents of all cells previously probed during the update. We refer to the 
reading or writing of a cell as probing the cell, hence the name cell probe model. The update time of a data 
structure is defined as the number of cells probed when processing an update. 

To answer a query, a data structure similarly probes a number of cells from the data structure and from 
the contents of the probed cells, the data structure must return the correct answer to the query. Again, 
the cell probed at each step, and the answer returned, may be an arbitrary function of the query and the 
previously probed cells. We similarly define the query time of a data structure as the number of cells probed 
when answering a query. 

Previous Results. In the following, we give a brief overview of the most important techniques that have 
been introduced for proving cell probe lower bounds for dynamic data structures. We also review the previous 
cell probe lower bounds obtained for orthogonal range counting and related problems. In Section [2] we then 
give a more thorough review of the previous techniques most relevant to this work, followed by a description 
of the key ideas in our new technique. 

In their seminal paper [2J, Fredman and Saks introduced the celebrated chronogram technique. They ap- 
plied their technique to the partial sums problem and obtained a lower bound stating that t q = Q(lgn/ \g(wt u )), 
where t q is the query time and t u the update time. In the partial sums problem, we are to maintain an array 
of n 0(w)-bit integers under updates of the entries. A query to the problem consists of two indices i and j, 
and the goal is to compute the sum of the integers in the subarray from index i to j. The lower bound of 
Fredman and Saks holds even when the data structure is allowed amortization and randomization. 

The bounds of Fredman and Saks remained the highest achieved until the breakthrough results of Patra§cu 
and Dcmaine In their paper, they extended upon the ideas of Fredman and Saks to give a tight lower 
bound for the partial sums problem. Their results state that t q \g(t u /t q ) — f2(lgn) and t u \g(t q /t u ) = f2(lgn) 

1 This is true under the most natural assumption of cell size 0(lgn). 
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when the integers have Q(w) bits, which in particular implies max{t q ,t u } = O(lgn). We note that they 
also obtain tight lower bounds in the regime of smaller integers. Again, the bounds hold even when allowed 
amortization and randomization. For the most natural cell size of w — 0(lgn), this remains until today the 
highest achieved lower bound. 

The two above techniques both lead to smooth tradeoff curves between update time and query time. While 
this behaviour is correct for the partial sums problem, there are many examples where this is certainly not 
the case. Patra§cu and Thorup [10] recently presented a new extension of the chronogram technique, which 
can prove strong threshold lower bounds. In particular they showed that if a data structure for maintaining 
the connectivity of a graph under edge insertions and deletions has amortized update time just o(lgn), then 
the query time explodes to n 1 ""^. 

In the search for super-logarithmic lower bounds, Patra§cu introduced a dynamic set-disjointness problem 
named the multiphase problem [8]. Based on a widely believed conjecture about the hardness of 3-SUM, 
Patrascu first reduced 3-SUM to the multiphase problem and then gave a series of reductions to different 
dynamic data structure problems, implying polynomial lower bounds under the 3-SUM conjecture. 

Finally, we mention that Patra§cu [5] presented a technique capable of proving a lower bound of max{t g , t u } = 
H((lg n/ lg lg n) 2 ) for dynamic weighted orthogonal range counting, but only when the weights are lg 2+e n-bit 
integers where e > is an arbitrarily small constant. For range counting with 5-bit weights, it is most natural 
to assume that the cells have enough bits to store the weights, since otherwise one immediately obtains an 
update time lower bound of 5/w just for writing down the change. Hence his proof is meaningful only in 
the case of w = lg 2+e n as well (as he also notes). Thus the magnitude of the lower bound compared to the 
number of bits, 5, needed to describe an update operation (or a query), remains below Q(5). This bound 
holds when t u is the worst case update time and t q the expected averagcl query time of a data structure. 

The particular problem of orthogonal range counting has received much attention from a lower bound 
perspective. In the static case, Patrascu [6] first proved a lower bound of t = fi(lgn/ lg(Sw/n)) where t is the 
expected average query time and S the space of the data structure in number of cells. This lower bound holds 
for regular counting (without weights), and even when just the parity of the number of points in the range 
is to be returned. In [7] he reproved this bound using an elegant reduction from the communication game 
known as lop-sided set disjointness. Subsequently J0rgensen and Larsen [_3| proved a matching bound for the 
strongly related problems of range selection and range median. Finally, as mentioned earlier, Patra§cu [6] 
proved a max{< ? , t u } — H((lg n/ lg lg n) 2 ) lower bound for dynamic weighted orthogonal range counting when 
the weights are lg 2+e n-bit integers. In the concluding remarks of that paper, he posed it as an interesting 
open problem to prove the same lower bound for regular counting. 

Our Results. In this paper we introduce a new technique for proving dynamic cell probe lower bounds. 
Using this technique, we obtain a lower bound of t q = Q((lg n/ \g(wt u )) 2 ), where t u is the worst case update 
time and t q is the expected average query time of the data structure. The lower bound holds for any cell 
size w = Q(lgn), and is the highest achieved to date in the most natural setting of cell size w — 0(lgn). For 
polylogarithmic t u and logarithmic cell size, this bound is t q = f2((lgn/lglgn) 2 ), i.e. almost a quadratic 
improvement over the highest previous lower bound of Patra§cu and Demaine. 

We prove the lower bound for dynamic weighted orthogonal range counting in two-dimensional space, 
where the weights are 0(lg n)-bit integers. This gives a partial answer to the open problem posed by Patra§cu 
by reducing the requirement of the magnitude of weights from lg 2+e n to just logarithmic. Finally, the lower 
bound is also tight for any update time that is at least lg 2+e n, hence deepening our understanding of one 
of the most fundamental range searching problems. 

Overview. In Section [5] we discuss the two previous techniques most related to ours, i.e. that of Fredman 
and Saks [2] and of Patra§cu [6]. Following this discussion, we give a description of the key ideas behind 
our new technique. Having introduced our technique, we first demonstrate it on an artificial range counting 
problem that is tailored for our technique (Section [3]) and then proceed to the main lower bound proof in 

2 i.e. for any data structure with a possibly randomized query algorithm, there exists a sequence of updates U, such that the 
expected cost of answering a uniform random query after the updates U is t q . 



3 



Section UJ Finally we conclude in Section [5] with a discussion of the limitations of our technique and the 
intriguing open problems these limitations pose. 

2 Techniques 

In this section, we first review the two previous techniques most important to this work, and then present 
our new technique. 

Fredman and Saks [2j. This technique is known as the chronogram technique. The basic idea is to 
consider batches, or epochs, of updates to a data structure problem. More formally, one defines an epoch i 
for each i = 1,... , lg^n, where j3 > 1 is a parameter. The i'th epoch consists of performing f3 l randomly 
chosen updates. The epochs occur in time from largest to smallest epoch, and at the end of epoch 1, every 
cell of the constructed data structure is associated to the epoch in which it was last updated. The goal is 
to argue that to answer a query after epoch 1, the query algorithm has to probe one cell associated to each 
epoch. Since a cell is only associated to one epoch, this gives a total query time lower bound of ^(Jgp n). 

Arguing that the query algorithm must probe one cell associated to each epoch is done by setting /3 
somewhat larger than the worst case update time t u and the cell size w. Since cells associated to an epoch 
j cannot contain useful information about an epoch i < j (the updates of epoch j were performed before 
knowing what the updates of epoch i was), one can ignore cells associated to such epochs when analysing 
the probes to an epoch i. Similarly, since all epochs following epoch i (future updates) writes a total of 
0(fi t ~ 1 t u ) = o(p l ) cells, these cells do not contain enough information about the /3 8 updates of epoch i to 
be of any use (recall the updates are random, thus there is still much randomness left in epoch i after seeing 
the cells written in epochs j < i). Thus if the answer to a query depends on an update of epoch i, then the 
query algorithm must probe a cell associated to epoch i to answer the query. 

We note that Fredman and Saks also defined the notion of epochs over a sequence of intermixed updates 
and queries. Here the epochs are defined relative to each query, and from this approach they obtain their 
amortized bounds. 

Patra§cu |6j. This technique uses the same setup as the chronogram technique, i.e. one considers epochs 
i = 1, . . . , lg^ n of updates, followed by one query. The idea is to use a static ^(lg^ n) lower bound proof to ar- 
gue that the query algorithm must probe r2(lg^ n) cells from each epoch if the update time is o((lg nj lglg n) 2 ), 
and not just one cell. Summing over all epochs, this gives a lower bound of f2(lg^ n). In the following, we 
give a coarse overview of the general framework for doing so. 

One first proves a lower bound on the amount of communication in the following (static) communication 
game (for every epoch i): Bob receives all epochs of updates to the dynamic data structure problem and 
Alice receives a set of queries and all updates of the epochs preceding epoch i. The goal for them is to 
compute the answer to Alice's queries after all the epochs of updates. 

When such a lower bound has been established, one considers each epoch i in turn and uses the dynamic 
data structure to obtain an efficient protocol for the above communication game between Alice and Bob. The 
key idea is to let Alice simulate the query algorithm of the dynamic data structure on each of her queries, 
and whenever a cell associated to epoch i is requested, she asks Bob for the contents. Bob replies and she 
continues the simulation. Clearly the amount of communication is proportional to the number of probes 
to cells associated to epoch z, and thus a lower bound follows from the communication game lower bound. 
The main difficulty in implementing this protocol is that Alice must somehow recover the contents of the 
cells not associated to epoch i without asking Bob for it. This is accomplished by first letting Bob send all 
cells associated to epochs j < i to Alice. For sufficiently large /?, this does not break the communication 
lower bound. To let Alice know which cells that belong to epoch i, Bob also sends a Bloom filter specifying 
the addresses of the cells associated to epoch i. A Bloom filter is a membership data structure with a false 
positive probability. By setting the false positive probability to l/lg c n for a large enough constant c > 0, 
the Bloom filter can be send using O(lglgn) bits per cell associated to epoch i. If t u = o((lgn/lglgn) 2 ), 
this totals o(f3 l lg 2 n/ lglgn) bits. 
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Now Alice can execute the updates of the epochs preceding epoch i (epochs j > i) herself, and she knows 
the cells (contents and addresses) associated to epochs j < i. She also has a Bloom filter specifying the 
addresses of the cells associated to epoch i. Thus to answer her queries, she starts simulating the query 
algorithm. Each time a cell is requested, she first checks if it is associated to epochs j < i. If so, she has the 
contents herself and can continue the simulation. If not, she checks the Bloom filter to determine whether 
it belongs to epoch i. If the Bloom filter says no, the contents of the cell was not updated during epochs 
j < i and thus she has the contents from the updates she executed initially. Finally, if the Bloom filter says 
yes, she asks Bob for the contents. Clearly the amount of communication is proportional to the number of 
probes to cells associated to epoch i plus some additional communication due to the t q j lg c n false positives. 

To get any lower bound out of this protocol, sending the Bloom filter must cost less bits than it takes to 
describe the updates of epoch i (Bob's input). This is precisely why the lower bound of Patra§cu requires 
large weights assigned to the input points. 

Our Technique. Our new technique elegantly circumvents the limitations of Patra§cu's technique by 
exploiting recent ideas by Panigrahy et al. [5] for proving static lower bounds. The basic setup is the same, 
i.e. we consider epochs i = l,...,lg^n, where the i'th epoch consists of /3 Z updates. As with the two 
previous techniques, we associate a cell to the epoch in which it was last updates. Lower bounds now follow 
by showing that any data structure must probe ^(lg^ n) cells associated to each epoch i when answering a 
query at the end of epoch 1. Summing over all lg^ n epochs, this gives us a lower bound of r2(lg^ n). 

To show that ^(lga n) probes to cells associated to an epoch i are required, we assume for contradiction 
that a data structure probing o(lg^ n) cells associated to epoch i exists. Using this data structure, we then 
consider a game between an encoder and a decoder. The encoder receives as input the updates of all epochs, 
and must from this send a message to the decoder. The decoder then sees this message and all updates 
preceding epoch i and must from this uniquely recover the updates of epoch i. If the message is smaller than 
the entropy of the updates of epoch i (conditioned on preceding epochs), this gives an information theoretic 
contradiction. The trick is to find a way for the encoder to exploit the small number of probed cells to send 
a short message. 

As mentioned, we use the ideas in [5] to exploit the small number of probes. In [5] it was observed that 
if S is a set of cells, and if the query algorithm of a data structure probes o(lg (9 n) cells from S on average 
over all queries (for large enough /?) , then there is a subset of cells S' C S which resolves a large number of 
queries. Here we say that a subset of cells S" C S resolves a query, if the query algorithm probes no cells in 
S\S' when answering that query. What this observation gives us compared to the approach of Patra§cu, is 
that we can find a large set of queries that are all resolved by the same small subset of cells associated to an 
epoch i. Thus we no longer have to specify all cells associated to epoch i, but only a small fraction. 

With this observation in mind, the encoder proceeds as follows: First he executes all the updates of all 
epochs on the claimed data structure. He then sends all cells associated to epochs j < i. For large enough f3, 
this message is smaller than the entropy of the /3 l updates of epoch i. Letting Si denote the cells associated 
to epoch i, the encoder then finds a subset of cells S- C Si, such that a large number of queries are resolved 
by SI- He then sends a description of those cells and proceeds by finding a subset Q of the queries resolved 
by S'i, such that knowing the answer to all queries in Q reduces the entropy of the updates of epoch i by 
more than the number of bits needed to describe S' i7 Q and the cells associated to epochs j < i. He then 
sends a description of Q followed by an encoding of the updates of epoch i, conditioned on the answers to 
queries in Q. Since the entropy of the updates of epoch i is reduced by more bits than was already send, 
this gives our contradiction (if the decoder can recover the updates from the above messages). 

To recover the updates of epoch i, the decoder first executes the updates preceding epoch i. His goal 
is to simulate the query algorithm for every query in Q to recover all the answers. He achieves this in the 
following way: For each cell c requested when answering a query q € Q, he examines the cells associated to 
epochs j < i (those cells were send by the encoder), and if c is contained in one of those he immediately 
recovers the contents. If not, he proceeds by examining the set If c is included in this set, he has again 
recovered the contents and can continue the simulation. Finally, if c is not in S^, then c must be associated 
to an epoch preceding epoch i (since queries in Q probe no cells in Si \ S'j), thus the decoder recovers the 
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contents of c from the updates that he executed initially. In this manner, the decoder can recover the answer 
to every query in Q, and from the last part of the message he recovers the updates of epoch i. 

The main technical challenge in using our technique lies in arguing that if o(lg /3 n) cells are probed 
amongst the cells associated to epoch i, then the claimed cell set S[ and query set Q exists. 

In Section[3]we first use our technique to prove a lower bound of t q = fl((\gn/ \g(wt u )) 2 ) for an artificially 
constructed range counting problem. This problem is tailored towards giving as clean an introduction of our 
technique as possible. In Section [4] we then prove the main result, i.e. a lower bound for dynamic weighted 
orthogonal range counting. 

3 An Artificial Range Counting Problem 

In the following, we design a range counting problem where the queries have some very desirable properties. 
These properties ease the lower bound proof significantly. We first describe the queries and then give some 
intuition on why their properties ease the proof. The queries are defined using the following lemma: 

Lemma 1. For n sufficiently large and any prime A, where n 4 /2 < A < n 4 , there exists a set V of n 2 
{0, 1} -vectors in [A]", such that for any yfn < k < n, it holds that if we consider only the last k coordinates 
of the vectors in V, then any subset of up to fc/221gfc vectors in V are linearly independent in [A] fe . 

We defer the (trivial) proof a bit and instead describe the artificial range counting problem: 

The Problem. For n sufficiently large and any prime A, where n 4 /2 < A < n 4 , let V = {vo, . . . ,v n 2_ 1 } 
be a set of n 2 {0, l}-vectors with the properties of Lemma [1] The set V naturally defines a range counting 
problem over a set of n points: Each of n input points po, . . . ,p n — l are assigned an integer weight amongst 
[A]. A query is specified by a vector Vj in V (or simply an index j £ [n 2 ]) and the answer to the query is 
the sum of the weights of those points pi for which the i'th coordinate of Vj is 1. An update is specified by 
an index i £ [n] and an integer weight 5 € [A] , and the effect of the update is to change the weight of point 
Pi to S. Initially, all weights are 0. 

Observe that this range counting problem has n 2 queries and the weights of points fit in lg A < 4 lg n bits. 
Thus the problem is similar in flavor to weighted orthogonal range counting. Lemma [T] essentially tells us 
that the answers to any subset of queries reveal a lot information about the weights of the n input points (by 
the independence). Requiring that the independence holds even when considering only the last k coordinates 
is exploited in the lower bound proof to argue that the answers to the queries reveal much information about 
any large enough epoch i. Finally, recall from Section [2] that our new technique requires us to encode a set 
of queries to simulate the query algorithm for. Since encoding a query takes lg ( | | ) = 21gn bits, we have 
chosen the weights to be 41gn-bit integers, i.e. if we can answer a query, we get more bits out than it takes 
to write down the query. 

Proof of Lemma [TJ We prove this by a probabilistic argument. Let n and A be given, where n 4 /2 < 
A < n 4 . Initialize V to the empty set. Clearly, for any y/n < k < n, it holds that any subset of up 
to fc/221gfc vectors in V are linearly independent in [A] fe when considering only the last k coordinates. 
We prove that as long as \V\ < n 2 , we can find a {0, l}-vector whose addition to the set V maintains 
this property. For this, consider a uniform random vector v in {0,1}™. For any y/n < k < n and any 
fixed set V' of up to fc/221gfc vectors in V, the probability that v is in the span of V when considering 
only the last k coordinates is at most A^ v '^/2 k < 2(' c / 221 s' £ ) 1 g A ^ fc < 2~ k / 2 . Since there are less than 
E-if 16 " (f) < (fc/221gfc)( fe/2 " 2 2 lgfc ) < (fc/221gfc)( fe/2 fe 2 8 lgfe ) < (2 2e Flgn)*/ 22 W < 2 fc /3 such sets in V, it 
follows from a union bound that with probability at least 1 — 2~ fe / 6 , v will not be in the span of any set of 
up to k/22lgk vectors in V when considering only the last k coordinates. Finally, by a union bound over 
all y/n < k < n, it follows that there must exists a vector that we can add to V , which completes the proof 
of Lemma [TJ 
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The remainder of this section is dedicated to proving a lower bound of t q = fi((lg nj \g(wt u )) 2 ) for any 
data structure solving this hard range counting problem. Here t u is the worst case update time, t q is the 
average expected query time, w the cell size and n the number of points. The proof carries most of the ideas 
used in the proof of the main result. 

3.1 The Lower Bound Proof 

The first step is to design a hard distribution over updates, followed by one uniform random query. We 
then lower bound the expected cost (over the distribution) of answering the query for any deterministic data 
structure with worst case update time t u . By fixing the random coins (Yao's principle this translates 

into a lower bound on the expected average query time of a possibly randomized data structure. 

Hard Distribution. The hard distribution is extremely simple: For i = 0, . . . , n — 1 (in this order), we 
simply set the weight of point pi to a uniform random integer £ [A]. Following these updates, we ask a 
uniform random query v *E V. 

We think of the updates as divided into epochs of exponentially decreasing size. More specifically, we 
define epoch 1 as consisting of the last updates (the updates that set the weights of points p n -p, ■ ■ ■ ,Pn-i), 
where j3 > 2 is a parameter to be fixed later. For 2 < i < lg^ n, epoch i consists of the /3 1 updates that 

precede epoch i — 1. Finally, we let epoch lg^ n consists of the n — Y^i=i * P l nrs ^ updates. 

For notational convenience, we let denote the random variable giving the sequence of updates per- 
formed in epoch i and U = Ui g(9 , . . . , Ui the random variable giving the updates of all epochs. Also, we let 
v denote the random variable giving the uniform random query in V. 

A Chronogram Approach. Having defined the hard distribution over updates and queries, we now give 
a high-level proof of the lower bound. Assume a deterministic data structure solution exists with worst 
case update time t u . From this data structure and a sequence of updates U, we define S(U) to be the 
set of cells stored in the data structure after executing the updates U. Now associate each cell in S(XJ) 
to the last epoch in which its contents were updated, and let S'i(U) denote the subset of S(XJ) associated 
to epoch i for i = 1, . . . ,lgg n. Also let tj(U, Vj) denote the number of cells in S'i(U) probed by the query 
algorithm of the data structure when answering the query Vj g V after the sequence of updates U. Finally, 
let ti(U) denote the average cost of answering a query Vj € V after the sequence of updates U, i.e. let 
fi(U) = Ylv-ev ^(U, Vj)/n 2 . Then the following holds: 

Lemma 2. If (3 — (wt u ) 2 , then E[i^( U, v)] = £l(\gan) for all |lg^n < i < lg^n. 

Before giving the proof of Lemma [2] we show that it implies our lower bound: Let /3 be as in Lemma [2] 
Since the cell sets <Si g/3 ra (U), . . . , Si(U) are disjoint, wc get that the number of cells probed when answering 
the query v is '^2 i ti(XJ It now follows immediately from linearity of expectation that the expected 
number of cells probed when answering v is ^(lg^ n ■ lg^ n) — 0((lg n/ \g(wt u )) 2 ) , which completes the proof. 

The hard part thus lies in proving Lemma [21 i.e. in showing that the random query must probe many 
cells associated to each of the epochs i = g lgg n, . . . , lg^ n — 1. 

Bounding the Probes to Epoch i. As also pointed out in Section [2l we prove Lemma [2] using an 
encoding argument. Assume for contradiction that there exists a data structure solution such that under 
the hard distribution, with /? = (wt u ) 2 , there exists an epoch llg^n < i* < \g^n, such that the claimed 
data structure satisfies E[£j« (U, v)] = o(lg /3 n). 

First observe that U,*« is independent of Ujg n ■ ■ ■ U,*+i, i.e. Hi\5^ \ Ui g(3 n ■ ■ ■ Uj*+i) = i?(Ui»), 

where H(-) denotes binary Shannon entropy. Furthermore, we have H(XJi*) = p l IgA, since the updates 
of epoch i* consists of changing the weight of /3 1 fixed points, each to a uniform random weight amongst 
the integers [A]. Our goal is to show that, conditioned on Ui g(3 „ • • -U^+i, we can use the claimed data 
structure solution to encode Ui* in less than i7(IL.») bits in expectation, i.e. a contradiction. We view this 
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encoding step as a game between an encoder and a decoder. The encoder receives as input the sequence of 
updates U = Ui g<3 „,..., Ui. The encoder now examines these updates and from them sends a message to 
the decoder (an encoding). The decoder sees this message, as well as Ui g n , . . . , U,«+i (we conditioned on 
these variables), and must from this uniquely recover Uj« . If we can design a procedure for constructing and 
decoding the encoder's message, such that the expected size of the message is less than if(U,*) = (3 l IgA 
bits, then we have reached a contradiction. 

Before presenting the encoding and decoding procedures, we show exactly what breaks down if the claimed 
data structure probes too few cells from epoch i*; 

Lemma 3. Let | lg^ n < i < \gpn be an epoch. If ti(U) — o(lgan), then there exists a subset of cells 
Ci(U) C Si(U) and a set of queries Q( V) C V such that: 

1. \C i {U)\ = 0{p i - 1 ). 

2. \Q(U)\=n(n). 

3. The query algorithm of the data structure solution probes no cells in Si(U)\Ci(U) when answering a 
query Vj £ Q( U) after the sequence of updates U. 

Proof. Pick a uniform random set C Z '(U) of /3 I_1 cells in iSj(U). Now consider the set Q'(U) of those queries 
vj in V for which i,(U, Vj) < jlggn. Since ti(XJ) — o(lga n) is the average of ti(XJ, Vj) over all queries 
Vj, it follows from Markov's inequality that |Q'(U)| = f2(|y|) = ft(n 2 ). Let Vj be a query in Q'(XJ). The 
probability that all cells probed from Sj(U) when answering Vj are also in C^(U) is precisely 

ft^cfij) } ) _ P'HP 1 - 1 -i)--- W 1 - 1 - *i(U, Vj ) + 1) 



(l^u)l) |SiCU)|(|Si(U)| - 1) ■ • • (|5 4 (U)| - ti(U, vj) + 1) 

^(^-^•••(^-ilg.n + l) 



> 



> 



> 



pHuipHu - 1) • • • (f3H u - I Igp n + 1) 



2/?t u 



It follows that the expected number of queries in Q'(U) that probe only cells in C t '(U) is n 3 / 2 and hence 
there must exist a set satisfying the properties in the lemma. □ 

The contradiction that this lemma intuitively gives us, is that the queries in Q(U) reveal more information 
about Ui than the bits in Cj(U) can describe (recall the independence properties of the queries in Lemma[T|). 
We now present the encoding and decoding procedures: 



Encoding. Let flggn < i* < lga^ be the epoch for which E[£j*(U,v)] = o(lg^n). We construct the 
message of the encoder by the following procedure: 

1. First the encoder executes the sequence of updates U on the claimed data structure, and from this 
obtains the sets Si s n(U), . . . , Si(U). He then simulates the query algorithm on the data structure 
for every query Vj € V. From this, the encoder computes tj* (U) (just the average number of cells in 
5,*(U) that are probed). 



8 



2. If ii.(U) > 2E[i l «(U,v)], then the encoder writes a 1-bit, followed by \/3 1 ' lg A] = iJ(U 4 .) + 0(1) 
bits, simply specifying each weight assigned to a point during the updates UV (this can be done in the 
claimed amount of bits by interpreting the weights as one big integer in [A^ ] ) . This is the complete 
message send to the decoder when ij*(U) > 2E[£i»(U, v)]. 

3. If f;»(U) < 2E[fi»(U,v)], then the encoder hrst writes a 0-bit. Now since i f .(U) < 2E[* i .(U,v)] = 
o(lg^n), we get from Lemma [3] that there must exist a set of cells Cj*(U) C SV(U) and a set of 
queries Q(U) C V satisfying the properties in Lemma [3J The encoder finds such sets Cj»(U) and 
Q(U) simply by trying all possible sets in some arbitrary but fixed order (given two candidate sets 
Cj'„(U) and Q'(U) it is straight forward to verify whether they satisfy the properties of Lemma [5J. 
The encoder now writes down the set C<»(U), including addresses and contents, for a total of at most 
0(w) +2\Ci*(V)\w bits (the 0(w) bits specifies \Ci*(U)\). Following that, he picks ft" /22 lg(^* ) 
arbitrary vectors in Q(U) (denote this set V) and writes down their indices in V. This costs another 
(ft* /22\g(ft*))\g(\V\) < (/3 l V221g(n 2 /3))l g ( n 2 ) = Uts _ 

4. The encoder now constructs a set X of vectors in [A] fei *, where = Y^i=\ft 1S the total size of 
all epochs j < i*. He initialized this set by first constructing the set of vectors V^., consisting of 
the vectors in V restricted onto the last fc,» coordinates. He then sets X = V fc '. ( and continues by 
iterating through all vectors in [A] fei *, in some arbitrary but fixed order, and for each such vector 
x = [xq, . . . ,Xk it —i), checks whether x is in span(X). If not, the encoder adds x to X. This process 
continues until dim(span(X)) = fcj«. Now let u = (uo, . . . , Ufe 4 » _i) be the fcj« -dimensional vector 
with one coordinate for each weight assigned during the last hi* updates, i.e. the z'th coordinate, 
Uj, is given by = d ra _fc.„+; for i = 0, . . . , ki* — 1. The encoder now computes and writes down 
((u, x) mod A) for each x that was added to X. Here (u, x) = Yli u i x i denotes the standard inner 
product. Since dim(span(V fe '. J) = |V fe '.„ | = ft" /22\g(/3 l " ) (by Lemma [TJ, this adds a total of \(kt* - 
) S i */221g(/3 i *))lgA] bits to the message. 

5. Finally, the encoder writes down all of the cell sets S'j»_i(U), . . . , S'i(U), including addresses and 
contents. This takes at most X}$=i (2|<5j(U)|io + 0(w)) bits. When this is done, the encoder sends 
the constructed message to the decoder. 

Before analyzing the size of the encoding, we show how the decoder recovers Ui* from the above message. 

Decoding. In the following, we describe the decoding procedure. The decoder receives as input the updates 
Uig n , . . . , Uj«+i (the encoding is conditioned on these variables) and the message from the encoder. The 
decoder now recovers U,» by the following procedure: 

1. The decoder examines the first bit of the message. If this bit is 1, then the decoder immediately 
recovers U*. from the encoding (step 2 in the encoding procedure). If not, the decoder instead ex- 
ecutes the updates Ui g/3 „ • • -TL^+i on the claimed data structure solution and obtains the cells sets 

Sj + i(U), • . • , S£#(U) where Sf +1 (U) contains the cells that were last updated during epoch j when 

executing updates Ui g U<»+i (and not the entire sequence of updates Ui g n , ■ ■ ■ , Ui). 

2. The decoder now recovers V, Ci* (U) and 5i*_i(U), . . . , £i(U) from the encoding. For each query Vj € 
V' , the decoder then computes the answer to Vj as if all updates Ui g n , . . . ,Ui had been performed. 
The decoder accomplishes this by simulating the query algorithm on each Vj , and for each cell requested, 
the decoder recovers the contents of that cell as it would have been if all updates Ujg „,..., Ui had 
been performed. This is done in the following way: When the query algorithm requests a cell c, the 
decoder first determines whether c is in one of the sets Si«_i(U), . . . , 5*1(11). If so, the correct contents 
of c (the contents after the updates U = Ujg Ui) is directly recovered. If c is not amongst these 
cells, the decoder checks whether c is in d* (U). If so, he has again recovered the contents. Finally, if c 
is not in d* (U), then from point 3 of Lemma[3j we get that c is not in Si* (U). Since c is not in any of 
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Si* (U), . . . , 5i(U), this means that the contents of c has not changed during the updates Ui* , . . . , Ui, 
and thus the decoder finally recovers the contents of c from ^^(U), . . . , 5|.^J(U). The decoder can 
therefore recover the answer to each query vj in V if it had been executed after the sequence of updates 
Ui g(3 n, . . . ,Ui, i.e. for all Vj € V, he knows Yn=o v iA ' ^ where Vjj denotes the i'th coordinate of 

Vj. 

3. The next decoding step consists of computing for each query vj in V, the value 5Zi=o 1 v j,n-k i ,+i ■ u^. 
Note that this value is precisely the answer to the query Vj if all weights assigned during epochs 
Igp n, . . . , i* + 1 were set to 0. Since we conditioned on Ui g n ■ ■ ■ Uj»+i the decoder computes this 

value simply by subtracting Y]™—q ** 1 Vjj ■ di from X^o* v J- i ' ^ (^ ne nrs ^ sum can be computed since 
di is given from Uj g n ■ ■ ■ Ui» + i when i < n — fcj» — 1). 

4. Now from the query set V', the decoder construct the set of vectors X = Vj£.„ , and then iterates 
through all vectors in [A] fei *, in the same fixed order as the encoder. For each such vector x, the 
decoder again verifies whether x is in span(X), and if not, adds x to X and recovers ((x, u) mod A) 
from the encoding. The decoder now constructs the fcj* x hi* matrix A, having the vectors in X as 
rows. Similarly, he construct the vector z having one coordinate for each row of A. The coordinate 
of z corresponding to a row vector x, has the value ((x, u) mod A). Note that this value is already 
known to the decoder, regardless of whether x was obtained by restricting a vector Vj in V' onto the 
last fcj* coordinates (simply taking modulo A on the value Yli=o 1 v j,n-k *+i 1 u i computed for the 
vector Vj in V' from which x was obtained), or was added later. Since A has full rank, and since the 
set [A] endowed with integer addition and multiplication modulo A is a finite field, it follows that the 
linear system of equations A ® y = z has a unique solution y g [A] fci * (here ® denotes matrix- vector 
multiplication modulo A). But u g [A] fei * and A <£> u = z, thus the decoder now solves the linear 
system of equations A £g) y = z and uniquely recovers u, and therefore also Uj« • • • Ui. This completes 
the decoding procedure. 

Analysis. We now analyse the expected size of the encoding of Ui* . We first analyse the size of the 
encoding when £i*(U) < 2E[tj* (U, v)]. In this case, the encoder sends a message of 

2\d. (U)\w + + (h, - f/22 \g{f )) lg A + 2|Sj(U)|«; + 0(w l g/3 n) 

3 = 1 

bits. Since H(U t ,) = /3 4 *lgA = h* lg A - Y?j=i ft lg A > \Ci*(U)\w = O^^w), IgA = 0(w) and 
| S'j (U) I < (3H U , the above is upper bounded by 

H (U^ ) + - {f /22 \g{f )) lg A + O ^urt„j . 

Since /3 > 2, we also have O (EjITi 1 ^wt^j = O (p i *- 1 wt u ) = o{p e ). Finally, we have lg A > lgn 4 - 1 > 

41g(/3 l ) — 1. Therefore, the above is again upper bounded by 

H(Ui. ) + ^/3 l * - ^/3 4 * + o(/3 r ) = H(Ui. ) - fi(/3 l * ). 

This part thus contributes at most 

Pr[ti.(U) < 2E[tj.(U,q)]] • (i/(U 4 .) - 

bits to the expected size of the encoding. The case where t i *(XJ) > 2E[tj*(U, v)] similarly contributes 
Pr[^. (U) > 2K[ti* (U, v)]] • (iJ(U i ») + 0(l)) bits to the expected size of the encoding. Now since v is uniform, 
we have E[t t > (U)] = E[^» (U, v)] , we therefore get from Markov's inequality that Pr[^« (U) > 2E[£,. (U, v)]] < 
|. Therefore the expected size of the encoding is upper bounded by 0(1) + i_ff(Uj.) + i(i7(U,») — ri(/3 i )) < 
H(XJi*) bits, finally leading to the contradiction and completing the proof of Lemma |2 
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4 Weighted Orthogonal Range Counting 



In this section we prove our main result, which we have formulated in the following theorem: 

Theorem 1. Any data structure for dynamic weighted orthogonal range counting in the cell probe model, 
must satisfy t q — f2((lg nj lg(wt u )) 2 ). Here t q is the expected average query time and t u the worst case update 
time. This lower bound holds when the weights of the inserted points are Q(lgn)-bit integers. 

As in Section [31 we prove Theorem Q] by devising a hard distribution over updates, followed by one 
uniform random query. We then lower bound the expected cost (over the distribution) of answering the 
query for any deterministic data structure with worst case update time t u . In the proof we assume the 
weights are 41gn-bit integers and note that the lower bound applies to any elgn-bit weights, where e > 
is an arbitrarily small constant, simply because a data structure for e lg n-bit integer weights can be used to 
solve the problem for any 0(lg u)-bit integer weights with a constant factor overhead by dividing the bits of 
the weights into \S/(elgn)~\ — 0(1) chunks and maintaining a data structure for each chunk. We begin the 
proof by presenting the hard distribution over updates and queries. 

Hard Distribution. Again, updates arrive in epochs of exponentially decreasing size. For i = 1, . . . , lg^ n 
we define epoch i as a sequence of f3 l updates, for a parameter (3 > 1 to be fixed later. The epochs occur 
in time from biggest to smallest epoch, and at the end of epoch 1 we execute a uniform random query in 
[n] x [n]. 

What remains is to specify which updates are performed in each epoch i. The updates of epoch i are 
chosen to mimic the hard input distribution for static orthogonal range counting on a set of /3 l points. We 
first define the following point set known as the Fibonacci lattice: 

Definition 1 ([4 ). The Fibonacci lattice F m is the set of m two-dimensional points defined by F m — 
{(i, ifk-i mod m) | i = 0, . . . , m — 1}, where m = fk is the k 'th Fibonacci number. 

The f3 l updates of epoch i now consists of inserting each point of the Fibonacci lattice Fm , but scaled 
to fit the input region [n] x [n], i.e. the j'th update of epoch i inserts the point with coordinates (n//3 l • 
j, n/ f3 l ■ (jfki—i mod /?*)), for j = 0, . . . , f3 l . The weight of each inserted point is a uniform random integer 
amongst [A], where A is the largest prime number smaller than 2 41g " — n 4 . This concludes the description 
of the hard distribution. 

The Fibonacci lattice has the desirable property that it is very uniform. This plays an important role in 
the lower bound proof, and we have formulated this property in the following lemma: 

Lemma 4 (PQ). For the Fibonacci lattice Fm, where the coordinates of each point have been multiplied by 
n/f3 % , and for a > 0, any axis-aligned rectangle in [0, n — n//3 l ] x [0, n — n//3 l ] with area an 2 j ' j5 l contains 
between \_a/a\\ and \a/a2~\ points, where ai w 1.9 and a-i ~ 0.45. 

Note that we assume each (3 l to be a Fibonacci number (denoted /fcj, and that each /3 l divides n. These 
assumptions can easily be removed by fiddling with the constants, but this would only clutter the exposition. 

For the remainder of the paper, we let Uj denote the random variable giving the sequence of updates 
in epoch i, and we let U = Ui g n ■ ■ ■ Ui denote the random variable giving all updates of all lg^ n epochs. 
Finally, we let q be the random variable giving the query. 

A Chronogram. Having defined the hard distribution over updates and queries, we proceed as in Section[3] 
Assume a deterministic data structure solution exists with worst case update time t u - From this data 
structure and a sequence of updates U = Ui g n , ■ ■ ■ , Ui, we define S(TJ) to be the set of cells stored in the 
data structure after executing the updates U. Associate each cell in 5(U) to the last epoch in which its 
contents were updated, and let 5j(U) denote the subset of 5(U) associated to epoch i for i = 1, . . . ,lgg n. 
Also let fcj(U, q) denote the number of cells in £j(U) probed by the query algorithm of the data structure 
when answering the query q € [n]x [n] after the sequence of updates U. Finally, let tj(U) denote the average 
cost of answering a query q £ [n]x [n] after the sequence of updates U, i.e. let ti(U) — J2 q e[n]x[n] q)/n 2 . 
Then the following holds: 
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Lemma 5. If (3 — (wt u ) 9 , then E[ii( U, q)] = ^(lg^ n) for all i > || lg^ n. 

The lemma immediately implies Theorem Q] since the cell sets S} g n(U), . . . , <Si(U) are disjoint and the 
number of cells probed when answering the query q is ^^(U, q). We prove Lemma [5] in the following 
section. 



4.1 Bounding the Probes to Epoch i 

The proof of Lemma [5] is again based on an encoding argument. The framework is identical to Section [3j 
but arguing that a "good" set of queries to simulate exists is significantly more difficult. 

Assume for contradiction that there exists a data structure solution such that under the hard distribu- 
tion, with (3 — (wt u ) 9 , there exists an epoch i* > j^lgpn, such that the claimed data structure satisfies 
Efe.(U,q)]=o(lg /J n). 

First observe that Ui* is independent of U^ n • • • U,-»+i, i.e. i?(U,;» | U gj3 „ • • • Ui* +1 ) = iJ(Ui*). 
Furthermore, we have i? (Ui* ) = f3 l lg A, since the updates of epoch i* consists of inserting /3 l fixed points, 
each with a uniform random weight amongst the integers [A]. Our goal is to show that, conditioned on 
Ui g)3 n • • • Ui*+i, we can use the claimed data structure solution to encode Ui* in less than i?(Uj») bits in 
expectation, which provides the contradiction. 

Before presenting the encoding and decoding procedures, we show what happens if a data structure 
probes too few cells from epoch i*. For this, we first introduce some terminology. For a query point 
q = (x, y) G [n] x [n], we define for each epoch i = 1, . . . , Igg n the incidence vector Xi(g), as a {0, l}-vector 

in [A]' 9 *. The j'th coordinate of Xi{l) lB 1 if the j'th point inserted in epoch i is dominated by q, and 
otherwise. More formally, for a query q = (x,y), the j'th coordinate Xi{l)j is given by: 



Xi(q)j = 



1 if jn/j3 l <x/\ (jfki-i mod j3 l )n/j3 l < y 
otherwise 



Similarly, we define for a sequence of updates Ui, the /3 l -dimensional vector for which the j'th coor- 
dinate equals the weight assigned to the j'th inserted point in U^. We note that Ui and Ui uniquely specify 
each other, since Ui always inserts the same fixed points, only the weights vary. 

Finally observe that the answer to a query q after a sequence of updates Ui g ^ „,..., Ui is 2j=i (Xi (l) i u i) ■ 
With these definitions, we now present the main result forcing a data structure to probe many cells from 
each epoch: 

Lemma 6. Let i > y| lg^ n be an epoch. Ifti( IT) — o(lgp n), then there exists a subset of cells Ci(lf) C Si(U) 
and a set of query points Q(U) C [n] x [n] such that: 

1. IQilTjl^O^w). 

2. \Q(U)\ = n([3^ 4 ). 

3. The set of incidence vectors Xi{Q(U)) — {Xi(l) I <Z G Q(U)} * s a linearly independent set of vectors in 
[Af. 

4- The query algorithm of the data structure solution probes no cells in Si(U)\Ci(U) when answering a 
query q € Q(U) after the sequence of updates U. 

Comparing to Lemma [31 it is not surprising that this lemma gives the lower bound. We note that 
Lemma [H essentially is a generalization of the results proved in the static range counting papers [HI 13] > 
simply phrased in terms of cell subsets answering many queries instead of communication complexity. Since 
the proof contains only few new ideas, we have deferred it to Section [5] and instead move on to the encoding 
and decoding procedures. 
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Encoding. Let i* > ^Ig^n be the epoch for which E[ij*(U, q)] = o(lg^n). The encoding procedure 
follows that in Section [3] uneventfully: 

1. First the encoder executes the sequence of updates U on the claimed data structure, and from this 
obtains the sets Sig n (U) ,...,Si (U) . He then simulates the query algorithm on the data structure for 
every query q G [n] x [n\. From this, the encoder computes tj»(U). 

2. If U* (U) > 2E[^« (U, q)] , then the encoder writes a 1-bit, followed by \(3 e lg A] = H(JJ t , ) + 0(1) bits, 
simply specifying each weight assigned to a point in Ui* . This is the complete message send to the 
decoder when U* (U) > 2E[^« (U, q)]. 

3. If ii»(U) < 2E[*i.(U,q)], then the encoder first writes a 0-bit. Now since i;»(U) < 2E[t i .(U,q)] = 
o(lgg n), we get from Lemma[B]that there must exist a set of cells Ci- (U) C Sj. (U) and a set of queries 
Q(U) C [n] x [n] satisfying 1-4 in Lemma[6] The encoder finds such sets Cj*(U) and Q(U) simply by 
trying all possible sets in some arbitrary but fixed order. The encoder now writes down these two sets, 
including addresses and contents of the cells in Cj»(U), for a total of at most 0(w) + 2|Cj* (U)|iu + 

lg(| Q "u)|) bits ( the °H bits specifies |CV(U)| and \Q(U)\). 

4. The encoder now constructs a set X, such that X — Xi*(Q(U)) = {xi*Q I 1 G Q(U)} initially. Then 
he iterates through all vectors in [A]^ , in some arbitrary but fixed order, and for each such vector 
x, checks whether x is in span(X). If not, the encoder adds x to X. This process continues until 
dim(span(X)) = f3 l , at which point the encoder computes and writes down ((x, u>) mod A) for each 
x that was added to X. Since dim(span(xi* (Q(U)))) = |Q(U)| (by point 3 in Lemma[6]), this adds a 
total of \(ft* - |<2(U)|)lg A] bits to the message. 

5. Finally, the encoder writes down all of the cell sets Si*-i(U), . . . ,Si(TJ), including addresses and 
contents, plus all of the vectors Uj»_i, . . . , ui. This takes at most J2]=i (2\Sj(U)\ w + ft lg A + 0(w)) 
bits. When this is done, the encoder sends the constructed message to the decoder. 

Next we present the decoding procedure: 

Decoding. The decoder receives as input the updates Ui g(3 n , . . . , Ui*+i and the message from the encoder. 
The decoder now recovers U^* by the following procedure: 

1. The decoder examines the first bit of the message. If this bit is 1, then the decoder immediately 
recovers Uj« from the encoding (step 2 in the encoding procedure). If not, the decoder instead ex- 
ecutes the updates Vi g/3 „ ■ ■ -U^+i on the claimed data structure solution and obtains the cells sets 

Sj g + n (U), . . . , 5|«^(U) where 5* +1 (U) contains the cells that were last updated during epoch j when 
executing only the updates Ui g «>•••> Ui» + i. 

2. The decoder now recovers Q(U), Ci- (U), iSi»_i(U), . . . , Si(XJ) and Uj«_i, . . . , Ui from the encoding. 
For each query q 6 Q(U), the decoder then computes the answer to q as if all updates Ui g ^ „,..., Ui 
had been performed. The decoder accomplishes this by simulating the query algorithm on q, and for 
each cell requested, the decoder recovers the contents of that cell as it would have been if all updates 
Ui g „,..., Ui had been performed. This is done as follows: When the query algorithm requests a cell 
c, the decoder first determines whether c is in one of the sets Sj*_i(U), . . . , Si(U). If so, the correct 
contents of c is directly recovered. If c is not amongst these cells, the decoder checks whether c is in 
Cj*(U). If so, the decoder has again recovered the contents. Finally, if c is not in Ci»(U), then from 
point 4 of Lemma El we get that c is not in 5j«(U). Since c is not in any of <Si»(U), . . . , Si(U), this 
means that the contents of c has not changed during the updates Ui*, . . . ,Ui, and thus the decoder 
finally recovers the contents of c from S?g + *(U), . . . , S^+^U). The decoder can therefore recover the 
answer to each query q in Q(U) if it had been executed after the sequence of updates U, i.e. for all 
q E Q(U), he knows Y,i=x {Xiiq) , u»>- 



13 



3. The next decoding step consists of computing for each query q in Q(U), the value (q), u>). For each 
q G Q(U), the decoder already knows the value Y^i=i {Xi(l) > u i) from the above. From the encoding of 
Uj»_i, . . . ,ux, the decoder can compute the value (Xi(Q)i u i) an d finally from U\ gfjn , . . . ,Uj*+i 
the decoder computes ^2i=i*+i{XiW)i u i)- The decoder can now recover the value {q), Ui») simply 
by observing that (xi* (q), Uj.) = E!=i"(x l ('7), u 4 > - (Xi(g), 

4. Now from the query set Q(U), the decoder construct the set of vectors X = Xi*(Q(U)), and then 
iterates through all vectors in [A]' 3 , in the same fixed order as the encoder. For each such vector 
x, the decoder again verifies whether x is in span(X), and if not, adds x to X and recovers (a;,u>) 
mod A from the encoding. The decoder now constructs the (3 l x p l matrix A, having the vectors in X 
as rows. Similarly, he construct the vector z having one coordinate for each row of A. The coordinate 
of z corresponding to a row vector x, has the value (x,Ui*) mod A. Since A has full rank, it follows 

that the linear system of equations A ® y = z has a unique solution y £ [A]@ . But £ [A]" and 
A (g> Ui* = z, thus the decoder solves the linear system of equations A ® y = z and uniquely recovers 
U;* , and therefore also U,* . This completes the decoding procedure. 

Analysis. We now analyse the expected size of the encoding of U \* . We first analyse the size of the 
encoding when ti*(\3) < 2E[t;. (U, q)]. In this case, the encoder sends a message of 

2|Ci. (U)\w + lg (jg^uji J + 08** " IQ(U)|) lg A + 0(w ]g p n )+J2 (2|^(U)k + ^ lg A) 

bits. Since f3 l " IgA = i/(Uj») and |Ci*(U)|w = o(|Q(U)|), the above is upper bounded by 

H(Ui.) - \Q(U)\ lg(A/n 2 ) + o(|Q(U)|) + (2|^-(U)h + ^ IgA). 

Since /3 > 2, we also have P j l E A < 2/ 31 *" 1 !g A = o(|Q(U)| lg A). Similarly, we have |5j(U)| < fi j t u , 

which gives us 5Zj=i 2|Sj-(U)|u; < 4/3* ~ lr wt u — o(|<5(U)|). From standard results on prime numbers, we 
have that the largest prime number smaller than n 4 is at least n 3 for infinitely many n, i.e. we can assume 
lg(A/n 2 ) = £1 (lg A). Therefore, the above is again upper bounded by 

fr(U t -.) - n(|Q(U)|lgA) = H(Ui.) - n(p'-v 4 \ g A). 

This part thus contributes at most 

PrMU) < 2E[^(U,q)]] • (#(11;*) - -3 / 4 IgA)) 

bits to the expected size of the encoding. The case where ti*(U) > 2E[£j* (U, q)] similarly contributes 
Pr[ti* (U) > 2E[ti» (U, q)]] • (H(XJi») + 0(1)) bits to the expected size of the encoding. Now since q is 
uniform, we have E[fj»(U)] = E[^*(U,q)], we therefore get from Markov's inequality that Pr[tj. (U) > 
2E[tj. (U, q)]] < |. Therefore the expected size of the encoding is upper bounded by 0(1) + iJJ(U,*») + 
i(if(Ui») - fX/3 l *~ 3 / 4 lgA)) < H{U t ,). This completes the proof of Lemma [5] 

5 The Static Setup 

Finally, in this section we prove Lemma [51 the last piece in the lower bound proof. As already mentioned, 
we prove the lemma by extending on previous ideas for proving lower bounds on static range counting. We 
note that we have chosen a more geometric (and we believe more intuitive) approach to the proof than the 
previous papers. 
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For the remainder of the section, we let U = U\ & n , . . . ,U% be a fixed sequence of updates, where each 
Uj is a possible outcome of Uj, and i > y| lgg n an epoch. Furthermore, we assume that the claimed data 
structure satisfies U(U) = o(lg»n), and our task is to show that the claimed cell set Ci and query set Q 
exists. 

The first step is to find a geometric property of a set of queries Q, such that Xi{Q) is a linearly independent 
set of vectors. One property that ensures this, is that the queries in Q are sufficiently well spread. To make 
this more formal, we introduce the following terminology: 

A grid G with width ji > 1 and height 7 > 1, is the collection of grid cells \j(A, (j + l)^t) x [/17, (h + 1)7) 
such that < j < n/ fi and < h < n/7. We say that a query point q = (x,y) € [n] x [n] hits a grid cell 
[jM? (j + I)/ 1 ) x [^7i C 1 + 1)7) of C, if the point (a;, y) lies within that grid cell, i.e. if j/i < x < (j + and 

< y < (h + 1)7. Finally, we define the hitting number of a set of queries Q' on a grid G, as the number 
of distinct grid cells in G that is hit by a query in Q' . 

With this terminology, we have the following lemma: 

Lemma 7. Let Q' be a set of queries and G a grid with width [i and height n 2 j for some parameter 
n//3 l < fi < n. Let h denote the hitting number of Q' on G. Then there is a subset of queries Q C Q' , such 
that \Q\ — Q(h — 6n//i — 6/i/3 l / n ) an d XiiQ) * s a linearly independent set of vectors in [A]* 9 . 

We defer the proof of Lemma [7] to Section 15. 1[ and instead continue the proof of Lemma O 
In light of Lemma[7l we set out to find a set of cells Cj C Si(U) and a grid G, such that the set of queries 
Qd that probe no cells in Si(U) \ C%, hit a large number of grid cells in G. For this, first define the grids 
G2, . . . , G21-2 where Gj has width n/ f3 l ~^ 2 and height n/fJ^ 2 . The existence of C, is guaranteed by the 
following lemma: 

Lemma 8. Let i > y| lg^ n be an epoch and Ui g/3 U\ a fixed sequence of updates, where each Uj is a 
possible outcome of Uj. Assume furthermore that the claimed data structure satisfies U(U) — o(lg^ n). Then 
there exists a set of cells Ci C Si(U) and an index j € {2, . . . , 2i — 2}, such that \Ci\ = 0(j5 l ~ 1 w) and Qc t 
has hitting number f2(/3' -3 / 4 ) on the grid Gj. 

To not remove focus from the proof of Lemma |6] we have moved the proof of this lemma to Section 15.21 
We thus move on to show that Lemma [7] and Lemma [5] implies Lemma [5] By assumption we have ti(U) = 
o(lgfl?i). Combining this with Lemma we get that there exists a set of cells Ci C Si(U) and an index 
j G {2, . . . , 2i — 2}, such that \d\ = 0(f3*~ 1 w) and the set of queries Qc t has hitting number f2(/3 1-3 / 4 ) on the 
grid Gj. Furthermore, we have that grid Gj is a grid of the form required by Lemma [Jj with /1 = n/fJ 1 ^^ 2 . 
Thus by Lemma[7jthere is a subset Q C Q c% such that \Q\ = ft(/3 1 - 3 / 4 ~ 12/3 1 " 1 ) = ft(^~ 3/4 ) and Xi(Q) is 
a linearly independent set of vectors in [A]* 3 . This completes the proof of Lemma [SI 

5.1 Proof of Lemma [7] 

We prove the lemma by giving an explicit construction of the set Q. 

First initialize Q to contain one query point from Q' from each cell of G that is hit by Q' . We will now 
repeatedly eliminate queries from Q until the remaining set is linearly independent. We do this by crossing 
out rows and columns of G. By crossing out a row (column) of G, we mean deleting all queries in Q that 
hits a cell in that row (column). The procedure for crossing out rows and columns is as follows: 

First cross out the bottom two rows and leftmost two columns. Amongst the remaining columns, cross 
out either the even or odd columns, whichever of the two contains the fewest remaining points in Q. Repeat 
this once again for the columns, with even and odd redefined over the remaining columns. Finally, do the 
same for the rows. We claim that the remaining set of queries are linearly independent. To see this, order the 
remaining queries in increasing order of column index (leftmost column has lowest index) , and secondarily in 
increasing order of row index (bottom row has lowest index). Let <?i) • - • , <7iqi denote the resulting sequence 
of queries. For this sequence, it holds that for every query qj, there exists a coordinate Xi(Qj)h: such that 
Xi(lj)h — 1) an d at the same time Xi{Qk)h = for all k < j. Clearly this implies linear independence. To 
prove that the remaining vectors have this property, we must show that for each query qj, there is some 
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point in the scaled Fibonacci lattice Fpi that is dominated by qj, but not by any of q\, . . . , qj-\\ Associate 
each remaining query qj to the two-by-two crossed out grid cells to the bottom- left of the grid cell hit by qj . 
These four grid cells have area 4n 2 //3* and are contained within the rectangle [0, n — nj x [0, n— n/ft z ], 
thus from Lemma 2] it follows that at least one point of the scaled Fibonacci lattice Fat is contained therein, 
and thus dominated by qj. But all qk, where k < j, either hit a grid cell in a column with index at least 
three less than that hit by qj (we crossed out the two columns preceding that hit by qj), or they hit a grid 
cell in the same column as qj but with a row index that is at least three lower than that hit by qj (we crossed 
out the two rows preceding that hit by qj). In either case, such a query cannot dominate the point inside 
the cells associated to qj. 

What remains is to bound the size of Q. Initially, we have \Q\ = h. The bottom two rows have a total 
area of 2n 3 //3 l /i, thus by Lemma 0] they contain at most 6n/fi points. The leftmost two columns have area 
2n/z and thus contain at most 6fj,f3 l /n points. After crossing out these rows and column we are therefore 
left with \Q\ > h — 6n/fi — 6/j,/3 l /n. Finally, when crossing out even or odd rows we always choose the 
one eliminating fewest points, thus the remaining steps at most reduce the size of Q by a factor 16. This 
completes the proof of Lemma [7J 

5.2 Proof of Lemma [5] 

We prove the lemma using another encoding argument. However, this time we do not encode an update 
sequence, but instead we define a distribution over query sets, such that if Lemma[H]is not true, then we can 
encode such a query set in too few bits. 

Let U = U\ s n , . . . , U\ be a fixed sequence of updates, where each Uj is a possible outcome of Uj. 
Furthermore, assume for contradiction that the claimed data structure satisfies both tj(f7) = o(lgsn) and 
for all cell sets C C Si(U) of size |C| = 0(/? i ~ 1 w) and every index j e {2, . . . , 2i - 2}, it holds that the 
hitting number of Qc on grid Gj is o(/3 1-3 / 4 ). Here Qc denotes the set of all queries q in [to] x [n] such that 
the query algorithm of the claimed data structure probes no cells in Si(U) \ C when answering q after the 
sequence of updates U. Under these assumptions we will construct an impossible encoder. As mentioned, 
we will encode a set of queries: 

Hard Distribution. Let Q denote a random set of queries, constructed by drawing one uniform random 
query (with integer coordinates) from each of the p l ~ l vertical slabs of the form: 

[hn/P i - 1 ,(h + l)n/0 i - 1 ) x [0,n), 

where h E [/3* -1 ]- Our goal is to encode Q in less than H(Q) — /3 I_1 lg(n 2 //3 l_1 ) bits in expectation. Before 
giving the encoding and decoding procedures, we prove some simple properties of Q: 

Define a query q in a query set Q' to be well- separated if for all other queries q' € Q', where q ^ q' , q 
and q' do not lie within an axis-aligned rectangle of area n 2 //3 1-1 / 2 . Finally, define a query set Q' to be 
well-separated if at least h\Q'\ queries in Q 1 are well-separated. We then have: 

Lemma 9. The query set Q is well-separated with probability at least 3/4. 

Proof. Let q h denote the random query in Q lying in the Zi'th vertical slab. The probability that q h lies within 
a distance of at most n//3 1-3 / 4 from the cc-border of the Ti'th slab is precisely (2n//3 l ~ 3 / 4 )/(ri//3 J_1 ) = 2//3 1 / 4 . 
If this is not the case, then for another query q fe in Q, we know that the x-coordinates of q ?l and q fe differ by at 
least h\ — l)n/ ft 1 ^ 1 + n/ (3 l ~ 3 / 4 . This implies that q h and q fc can only be within an axis-aligned rectangle 
of area n 2 //? 1 " 1 / 2 if their y-coordinates differ by at most n/((\k — h\ — l)f3 x / 2 + /3 1 / 4 ). This happens with 
probability at most 2/((|fc -h\- l)^ 1 / 2 + /3 1 / 4 ). The probability that a query q h in Q is not well-separated 
is therefore bounded by 

2 _ 2 2 10 2 _ / 1 lgn\ 

~ ]PT*' fr'. (jjfe -h\- l)/3!/2 + £1/4 - 0TJ4 \ k _ h \pl/2 ~ (jTJI + ) • 
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Since /3 = (wt u ) 9 — w(lg 2 n) this probability is o(l), and the result now follows from linearity of expectation 
and Markov's inequality. □ 



Now let Si(Q,U) C Si(U) denote the subset of cells in Si(U) probed by the query algorithm of the 
claimed data structure when answering all queries in a set of queries Q after the sequence of updates U (i.e. 
the union of the cells probed for each query in Q). Since a uniform random query from Q is uniform in 
[n] x [n], we get by linearity of expectation that E[|Sj(Q, U)\] — /3 l ~ 1 ti(U). From this, Lemma|Hl Markov's 
inequality and a union bound, we conclude 

Lemma 10. The query set Q is both well- separated and \Si(Q,U)\ < 4/3 t ~ 1 ti(U) with probability at least 
1/2. 

With this established, we are now ready to give an impossible encoding of Q. 



Encoding. In the following we describe the encoding procedure. The encoder receives as input the set of 
queries Q. He then executes the following procedure: 

1. The encoder first executes the fixed sequence of updates U on the claimed data structure, and from 
this obtains the sets S\ g n (U), . . . , Si(U). He then runs the query algorithm for every query q 6 Q 
and collects the set Si(Q, U). 

2. If Q is not well-separated or if |5j(Q, U)\ > A(3 l ~ 1 t i {U), then the encoder sends a 1-bit followed by a 
straightforward encoding of Q using H(Q) + 0(1) bits in total. This is the complete encoding procedure 
when either Q is not well-separated or |Sj(Q, U)\ > 4:(3 t ~ 1 t i (U). 

3. If Q is both well-separated and |Si(Q, U)\ < 4/3 l_1 ii(t/), then the encoder first writes a 0-bit and then 
executes the remaining four steps. 

4. The encoder examines Q and finds the at most ^|Q| queries that are not well-separated. Denote this 
set Q . The encoder now writes down Q by first specifying |Q |, then which vertical slabs contain 
the queries in Q' and finally what the coordinates of each query in Q' is within its slab. This takes 
0(w) + lg (gl) + |Q'| Xgin 2 /^- 1 ) = O(w) + Oifi^ 1 ) + |Q'| k^n 2 //?*" 1 ) bits. 

5. The encoder now writes down the cell set Si(Q, U), including only the addresses and not the contents. 
This takes o(H(Q)) bits since 



Si(Q,U)\ 



oip-Hgin 2 /^- 1 )), 



where in the first line we used that \Si(U)\ < f3H u and \Si(Q,U)\ < 4(3 i ^ 1 t i (U). The second line 
follows from the fact that U(U) = o(\gg n) = o(lg(n 2 //3 4-1 )/ \g{j3t u )) since /? = u}(t u ). 

Next we encode the ^-coordinates of the well-separated queries in Q. Since we have already encoded 
which vertical slabs contain well-separated queries (we really encoded the slabs containing queries that 
are not well-separated, but this is equivalent), we do this by specifying only the offset within each slab. 
This takes (|Q| — |Q'|) lg("//5 1_1 ) + 0(l) bits. Following that, the encoder considers the last grid G2i_2, 
and for each well-separated query q, he writes down the y-offsct of q within the grid cell of C?2i-2 hit by q. 
Since the grid cells of G 2l _ 2 have height n//?'" 1 , this takes (|Q|-|Q'|) lg(n//3^ 1 )+0(l) bits. Combined 
with the encoding of the ^-coordinates, this step adds a total of (|Q| — |Q'|) lg(n 2 //3 2l ~ 2 ) + 0(1) bits 
to the size of the encoding. 

In the last step of the encoding procedure, the encoder simulates the query algorithm for every query 
in [n] x [n] and from this obtains the set Qsacz,u)i i- e - the set of all those queries that probe no cells 
in Si(U) \ Si(Q, U). Observe that Q C Qsi{Q,u)- The encoder now considers each of the grids Gj, for 



17 



j = 2, . . . , 2i — 2, and determines both the set of grid cells Gj SiiQ - u} c Gj hit by a query in Qsi(Q,u), 
and the set of grid cells G^ C ^ s i< Q C/ ' g Gj hit by a well-separated query in Q. The last step of the 
encoding consists of specifying G®. This is done by encoding which subset of G^''^'"' corresponds 

to Gj. This takes lg (' 3 ^ ') bits for each j = 2, . . . , 2i - 2. 

Since |5*i(Q, ?7)| = o(/3 l_1 lg^ n) — o((3' t ~ 1 w) we get from our contradictory assumption that the hitting 

number of Q Si (Q,u) on each grid G 3 is o(/3*- 3 / 4 ), thus \G® Si(Q ' u) \ = o(/3 4 - 3 / 4 ). Therefore the above 
amount of bits is at most 

(|Q| - |Q'|) lg(/3 l - 3 / 4 e /(IQI - |Q'|))(2i - 3) < 
(IQI - IQ'D lg(/? 1/4 )2i + O^"^) < 
(|Q| - |Q'|)i lg(/?)2 lg fj n + OiP' 1 lg fj n) < 
(|Q|-|Q'|)|lgn + o(H(Q)). 

This completes the encoding procedure, and the encoder finishes by sending the constructed message 
to the decoder. 

Before analysing the size of the encoding, we show that the decoder can recover Q from the encoding. 

Decoding. In this paragraph we describe the decoding procedure. The decoder only knows the fixed 
sequence U = U\ Kfj „,..., U\ and the message received from the encoder. The goal is to recover Q, which is 
done by the following steps: 

1. The decoder examines the first bit of the message. If this is a 1-bit, the decoder immediately recovers 
Q from the remaining part of the encoding. 

2. If the first bit is 0, the decoder proceeds with this step and all of the below steps. The decoder executes 
the updates U on the claimed data structure and obtains the sets Si gfj n (U), . . . , S\(U). From step 4 
of the encoding procedure, the decoder also recovers Q'. 

3. From step 5 of the encoding procedure, the decoder now recovers the addresses of the cells in S,(Q, U). 
Since the decoder has the data structure, he already knows the contents. Following this, the decoder 
now simulates every query in [n] x [n], and from this and Si(Q, U) recovers the set QsdQ,u)- 

4. From step 6 of the encoding procedure, the decoder now recovers the ^-coordinates of every well- 
separated query in Q (the offsets are enough since the decoder knows which vertical slabs contain 
queries in Q', and thus also those that contain well-separated queries). Following that, the decoder 
also recovers the y-offset of each well-separated query q e Q within the grid cell of G21-2 bit by q (note 
that the decoder does not know what grid cell it is, he only knows the offset). 

5. From the set Qsi(Q.u) the decoder now recovers the set Q® s i<- Q - U> f or j — 2, . . . , 2i — 2. This 
information is immediate from the set Qsi(Q.u)- From Gj Si(Q,u) and step 7 of the encoding procedure, 
the decoder now recovers G^ for each j. In grid G2, we know that Q has only one query in every 
column, thus the decoder can determine uniquely from G^ which grid cell of G2 is hit by each well- 
separated query in Q. Now observe that the axis-aligned rectangle enclosing all /3 1 / 2 grid cells in Gj+i 
that intersects a fixed grid cell in Gj has area n 2 //3 J ~ 1//2 . Since we are considering well-separated 
queries, i.e. queries where no two lie within an axis-aligned rectangle of area n 2 //3 1-1 / 2 , this means 
that Gj +1 contains at most one grid cell in such a group of ft 1 / 2 grid cells. Thus if q is a well-separated 
query in Q, we can determine uniquely which grid cell of Gj+i that is hit by q, directly from G^ +1 and 
the grid cell in Gj hit by q. But we already know this information for grid G2, thus we can recover 
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this information for grid G3, G4, . . . , Gn-2- Thus we know for each well-separated query in Q which 
grid cell of G21-2 it hits. From the encoding of the ^-coordinates and the y-offsets, the decoder have 
thus recovered Q. 

Analysis. Finally we analyse the size of the encoding. First consider the case where Q is both well- 
separated and |5i(Q, U)\ < -i(3 t ~ 1 t i (U). In this setting, the size of the message is bounded by 

|Q'| Un 2 /^- 1 ) + (|Q| - |Q'|)(lg(n 2 //3 21 - 2 ) + £lgn) + o(H(Q)) 

bits. This equals 

|Q| lg(n 2+1 /2//? 2 *- 2 ) + |Q'| lg^-Vn 1 ^) + (H(Q)) 

bits. Since we are considering an epoch i > ^| lg^ n, we have lg(n 2+1 / 2 //3 2l ~ 2 ) < lg(n 5 / 8 /3 2 ), thus the above 
amount of bits is upper bounded by 

|Q|lg(n 5 / 8 /3 2 ) + |Q'|lg(n 1 /2) +o(jff (Q)). 

bmce IQ'I < ||Q|, this is again bounded by 

|Q|lg(n 7 / 8 /3 2 )+ (if(Q)) 

bits. But H(Q) = |Q| lg(n 2 //3 4 ) > |Q| lgn, i.e. our encoding uses less than y|if(Q) bits. 

Finally, let E denote the event that Q is well-separated and at the same time \Si(Q,U)\ < 4f3' l ~ 1 t i (U), 
then the expected number of bits used by the entire encoding is bounded by 

0(1) + Pr[£](l - n(l))H(Q) + (1 - Pt[E])H(Q) 

The contradiction is now reached by invoking Lemma [TOl to conclude that Pr[i?] > 1/2. 

6 Concluding Remarks 

In this paper we presented a new technique for proving dynamic cell probe lower bounds. With this technique 
we proved the highest dynamic cell probe lower bound to date under the most natural setting of cell size 
w — O(lgn), namely a lower bound of t q = Q,({\gn/ lg(wt u )) 2 ). 

While our results have taken the field of cell probe lower bounds one step further, there is still a long 
way to go. Amongst the results that seems within grasp, we find it a very intriguing open problem to prove 
an w(lg n) lower bound for a problem where the queries have a one bit output. Our technique crucially relies 
on the output having more bits than it takes to describe a query, since otherwise the encoder cannot afford 
to tell the decoder which queries to simulate. Since many interesting data structure problems have a one 
bit output size, finding a technique for handling this case would allow us to attack many more fundamental 
data structure problems. As a technical remark, we note that when proving static lower bounds using the 
cell sampling idea, the encoder does not have to write down the queries to simulate. This is because queries 
are completely solved from the cell sample and need not read any other cells. Hence the decoder can simply 
try to simulate the query algorithm for every possible query and simply discard those that read cells outside 
the sample. In the dynamic case, we still have to read cells associated to other epochs. For the future 
epochs (small epochs), this is not an issue since we know all these cells. However, when simulating the query 
algorithm for a query that is not resolved by the sample, i.e. it reads other cells from the epoch we are 
deriving a contradiction for, we cannot recognize that the query fails. Instead, we will end up using the cell 
contents written in past epochs and could potentially obtain an incorrect answer for the query and we have 
no way of recognizing this. We believe that finding a way to circumvent the encoding of queries is the most 
promising direction for improvements. 

Applying our technique to other problems is also an important task, however such problems must again 
have a logarithmic number of bits in the output of queries. 
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